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1. Introduction 

Let (Ai,g) be a smooth compact Riemannian manifold of dimension n > 3. 
The Yamabe problem is to find metrics conformal to g with constant scalar 
^ curvature. The problem has been solved through the work of Yamabe [48], 

Trudinger [40], Aubin [2] and Schoen [36]. See [25] for a survey. The Yamabe 
and related problems have attracted much attention in the last 30 years or 
so, see, e.g., [38], [3] and the references therein. Analogues of the Yamabe 
problem on compact manifolds (Ai,g) with boundary have been studied by 
Cherrier [9], Escobar [11, 12, 13], Han and Li [23, 24], Ambrosetti, Li and 
Malchiodi [1] and others. 

In recent years, fully nonlinear versions of the Yamabe problem have re- 
ceived much attention since the work of Viaclovsky [46]. Let (A4 n ,g) be a 
smooth compact Riemannian manifold of dimension n > 3. The Schouten 
tensor is defined as 



•3 



"*^ ' A a := I Ric a rR Q 

,g ■ 9 n-2\ g 2(n-l) 9y 



S 



a 



where Ric g and R g are the Ricci tensor and the scalar curvature of g respec- 
tively. Let X(A g ) = (Xi(Ag), ■ ■ • , X n (A g )) denote the eigenvalues of A g with 
respect to g. One interesting problem is to find conformal metrics on (/A, g) 
^ with a prescribed symmetric function of the eigenvalues of the Schouten ten- 

sors. 

To be more precise, let 

ri:={A = (A 1 ,---,A n )GM n :^A J >0} 

and 

T n := {A = (Ai, ■ ■ ■ A n ) G W 1 : A 4 > for 1 < i < n} . 
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We assume that 

(1.1) r C 1" is an open convex symmetric cone with vertex at the origin 

satisfying 

(1.2) r„ c r c r\ 

and assume that 

(1.3) / G C°°(r) n C°(r) is a symmetric function, / > in T 

verifying some of the following properties which will be specified in each 



situation: 
(1.4) 


/ is homogeneous of degree one on T 


(1.5) 


fi := |f > on T, 


and 




(1.6) 


f is concave on T. 



Conditions (1.4), (1.5) and (1.6) imply that (see [43, Lemma 3.2]) 

(1.7) T:=^/,(A)>c >0, VAer 

i 

for some positive number Co > 0. 

The fully nonlinear Yamabe problem on a closed manifold (Ai, g) is to find 
a metric g conformal to g such that 

(1.8) F{Ag) := f(X(A~ g )) = 1 and \(A~ g ) e T on M. 

When (/, T) = (a k ,Tk), this problem is known as the a^ -Yamabe problem 
in the literature, where, for each 1 < k < n, ak is the /c-th elementary 
symmetric function defined by 

<7 fc (A):= J2 X h---K forallA = (A 1 ,---,A n )GM" 

h<---<i k 
and 

T k := {A G M" : a t (X) >0,l<l<k} 
which is an open convex symmetric cone with vertex at the origin. 

For problem (1.8) a number of existence results have been available in the 
literature. In [45] Viaclovsky established the existence result for (1.8) with 
(/, T) = (cr n , r n ) for a class of manifolds. In [5, 6], Chang, Gursky and 
Yang obtained the existence result on 4-manifolds for (1.8) with (/, T) = 
(a - 2 ' ,r 2 ). For (/, T) = (a k , Tk) with k = 3,4 on 4-manifolds and with 
k = 2, 3 on 3-manifolds that are not simply connected, the existence result 
was established by Gursky and Viaclovsky in [21]. When (Ai,g) is locally 

conformally flat and (/, T) = (a k , Tk) for 1 < k < n, Guan-Wang [18] 



and Li-Li [26] independently proved the existence of solutions of (1.8). Li-Li 
[26, 29] also established a general result that (1.8) is still solvable if (Ai,g) is 
locally conformally flat and if (/, T) satisfies (1.1)— (1.6) with f\gr = 0. In [19] 
Guan and Wang proved local interior C l and C 2 estimates for solutions of 

(1.8) with (/, T) = (a k ,Tfc), such estimates were also studied in [26, 20, 39] 
and was extended to a general class of (/, T) in [7]. Using such local estimates 
and the algebraic fact found in [17] that X(A g ) G Tj, for k > | implies the 
positivity of the Ricci tensor, Gursky and Viaclovsky [22] solved (1.8) on 
general manifolds if (/, T) satisfies (1.1)— (1.6) with f\g-p = and if T C Tj, 
for some k > V- . In [42] Trudinger and Wang proved a Harnack inequality for 
the set of metrics g conformal to g with X(A g ) G Tk for some k > | and gave 

a different proof of the existence result in [22]. For (/, T) = (a k , Tk) with 
k < § on general manifolds, Sheng, Trudinger and Wang [39] established the 
existence result under a variational structure condition which includes the 
case k = 2 and n > 4, while Ge and Wang [14] independently obtained a 
proof for k = 2 and n > 8. 

In the rest of this paper we will assume that (Ai n ,g), n > 3, is a smooth 
compact Riemannian manifold with nonempty smooth boundary DM.. For a 
given constant c G R, we are interested in finding a metric g conformal to g 
such that 

f F(A 5 ) := f(X(A- g )) = 1, A(A 5 ) G T on M, 

(1.9) <^ 

where /i^ denotes the mean curvature of <9.M with respect to the outer normal 
(A Euclidean ball has positive boundary mean curvature). Note that when 
(/, r) = (o"i,ri), this is the Yamabe problem on a compact manifold with 
boundary. Therefore (1.9) is a fully nonlinear version of the Yamabe problem 
with boundary. 

This problem was proposed by Li and Li in [28, 30] in which they considered 
the corresponding blow-up problem of (1.9) and obtained some Liouville type 
theorems and a Harnack type inequality. These results indicate positively 
that it should be possible to establish some existence results for (1.9) under 
suitable conditions. 

Writing g = e~ 2u g for some smooth function itonM. Using the transfor- 
mation laws for the Schouten tensor and mean curvature, (1.9) is equivalent 
to the fully nonlinear elliptic equations 

F(U) := f(X g (U)) = e~ 2u , X g (U)eT on M, 

;i.io) 



|h = ce-u _ hg on dM 



with 



1.11) U = V 2 u + du®du--\Vu\ 2 g + A Q 



\gU i ^91 



where X g (U) denotes the eigenvalues of U with respect to g, v is the unit 
inward normal vector field to dM in (M,g) and V denotes the Levi-Civita 
connection with respect to g. 

Recall that the second fundamental form II of dM with respect to g is 
defined as 

U(X, Y) := -g(V x v, Y), for any X, Y G T(dM), 

where T(dM) denotes the tangent bundle over dM. A point x G dM is 
called an umbilic point in (M,g) if 

U(X, Y) = h g (x)g(X, Y) for all X,Y e T x (dM). 

The boundary dM is called umbilic if every point of dM is an umbilic point. 
The notion of umbilic point is conformally invariant, i.e. a point is umbilic 
with respect to g is still umbilic with respect to the metric g := e~ 2u g for 
any function u G C 2 (M) (see [12]). 

Our first existence result is for locally conformally flat manifolds with 
umbilic boundary. 

Theorem 1.1. Assume that (/, T) satisfies (1.1)-(1.6) with j\qy = and 
that (M,g) is a smooth compact locally conformally flat Riemannian mani- 
fold with smooth umbilic boundary dM. Suppose that X(A g ) G T on M and 
h g > on dM. Then problem (1.10) with c = has a solution u G C°°(M). 

The existence of solutions of (1.8) with (/, Y) satisfying (1.1)— (1.6) and 
f\dv — has been proved in [27, 29] on compact locally conformally flat 
manifolds without boundary. The proof of Theorem 1.1 is based on [27, 29]. 
By making use of the double of a compact manifold, the problem in Theo- 
rem 1.1 reduces to a corresponding problem on compact locally conformally 
flat manifold without boundary. In order to establish C° estimates, via the 
Harnack inequality obtained in [27], we need to assume h g > on dAi. 

Recall that the Yamabe problem on compact manifolds (Ai, g) with bound- 
ary (9.M is to find a conformally related metric g of constant scalar curvature 
on At and constant mean curvature on <9.M. By writing g = u n ~ 2 g for 
some positive smooth function on At, this problem is equivalent to finding a 
smooth positive solution u to the boundary value problem 

4(n-l) a D -2-t§ « A 

A u + R u = au n - 2 on M, 



n-2 "9" ' ±l -9 

:i.i2) ; __ 

■-^tt + hnU = en™- 2 on dM 

where a and c are constants. For any a > and any c, the existence of 
a solution of (1.12) has been proved in [23, 24] under the assumption that 
(M,g) is of positive type and satisfies one of the following assumptions: 

(i) (M n ,g), n > 3, is locally conformally flat with umbilic boundary; 
(ii) n > 5 and M is not umbilical. 



For any a > 0, it was proved earlier in [12, 13] that (1.12) is solvable for 
c = and for at least one c + (a) > and one c_(a) < under the same 
assumptions. Here we call a manifold (M,g) of positive type if 

where c(n) = jg^y. 

An interesting question for (1.9) is to identify good conditions which guar- 
antee the existence of a solution. Theorem 1.1 is such an attempt, and it 
shows that h g > on dM is a sufficient condition. Unlike the Yamabe prob- 
lem with boundary, we tend to believe that the hypothesis u h g > on dM" 
in Theorem 1.1 can not be replaced by u Xi(M) > 0". 

Our next result concerns (1.10) with c > 0. We consider more general 
equation 

f F(U) := f(X g (U)) = Vo e- 2u , X g (U) G T on M, 
(1.13) 

[ % = h e' u -h g on dM, 

where <p G C°°(M) and /i G C°°(dM) are positive functions. This problem 
is equivalent to finding a metric g conformal to g such that f(X(Ag) = (p on 
M. and /i§ = ho on 97V1. 

Theorem 1.2. Assume that (/, T) satisfies (1.1)-(1.6) with j\qy = and 
T C Tfc /or some A; > |. Let (.M,g) &e a smooth compact Riemannian 
manifold with smooth boundary DM.. Suppose that X(A g ) G T on Ai, h g > 
on 97V1, 97W is umbilic, and (Ai,g) is locally conformally flat near dM.. 
Then for any positive functions y?o G C°°(M) and /i G C°°(dAi) problem 

(1.13) has a solution u G C°°(M). 

In [22, 42] more general equations than (1.8) on general closed manifolds 
have been solved when T C T^ for some k < |. By using the double of 
a manifold we adapt the Harnack inequality of Trudinger-Wang [42] to our 
situation. This, together with the C 1 and C 2 estimates in sections 2-4, allows 
us to obtain the existence result by modifying the degree argument in [42]. 

In sections 2-3 we establish under suitable conditions on (/, T) some local 
C 1 and C 2 estimates for solutions of the following more general equation 

f F(U) := f(X g (U)) = i>(x, n), X g {U) G Y on 1 , 

(1.14) <^ 

[ ^=r](x,u)-h g ondndM, 

where Ox is an open set of M, U is defined by (1.11), ip G C 2 {0\ x R) 
and f] G C 2 ((Oi fl dM) x M). By extension we can always assume that 
T) G C 2 (d Xl). 

C 1 and C 2 estimates have been studied extensively on closed manifolds, 
see [19, 26, 20, 39, 7] for local interior estimates and [45] for global estimates. 



du_ ce -u_ h ondndM, 



Global estimates have also been studied in [16] on compact manifolds under 
Dirichlet boundary condition. 

The first result on gradient estimates is the following. 

Theorem 1.3. Assume that (/, T) satisfies (1.1)-(1.5), (1-7) and that (A4,g) 
is a smooth compact Riemannian manifold with smooth boundary dAi. Let 
0\ be an open set of M. and let u G C 3 (Oi) be a solution of (1.14)- If 

(1.15) a<u<b on0 1 

for some constants a and b, then, for any open set 2 of At satisfying 2 C 

\Vu\ g <C on0 2 
for some positive constant C depending only on n (/, Y), g, ip, rj, a, b, 0\ 
and 2 . 

Note that the gradient estimate given in Theorem 1.3 depends on the 
bound of \u\ on 0\. If we only know u > —Co on Oi, the next result gives 
the gradient estimates for solutions of the equation 

( F(U) := f(X g (U)) = e~ 2u , \ g (U) G T on O u 
(1.16) 

I ~dv ~ °° '"9 

where 0\ is an open set of A4, if (/, T) further satisfies the condition (H a ) 
introduced in [26], see Definition 2.1 in section 2, 

Theorem 1.4. Assume that (/, T) satisfies (1.1)-(1.5), (1.7) and the condi- 
tion {Hi), and that (M.,g) is a smooth compact Riemannian manifold with 
smooth boundary DM.. Let 0\ be an open set of M. and let u G C 3 (Oi) be a 
solution of (1.16). If 

u > —C on 0\ 

for some constant C , then, for any open set 2 of M. satisfying 2 C 0\, 

|V«| fl < C on0 2 
for some positive constant C depending only on n, c, (f, V), g, C , 0\ and 

o 2 . 

By assuming that DM. is umbilic and that (Ai,g) is locally conformally 
flat near dAi, we derive in section 3 we derive the following C 2 estimates for 
solutions of (1.14) under suitable conditions on ip and 77. 

Theorem 1.5. Assume that (/, T) satisfies (1. !)-(!. 6) and that (Ai,g) is a 
smooth compact Riemannian manifold with smooth boundary dM.. Suppose 
that DM. is umbilic and (Ai,g) is locally conformally flat near dAi. Let 0\ 
be an open set of M. and let u G C A {Oi) be a solution of (1.14). Assume 
that ip and r] satisfy one of the following conditions: 

(i) r] = 0, §£ = on (d n dM) xRandiPe C 3 (Ci x R); 
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(ii) i] is positive on [0\ x d At) x M. and ip is any function on 0\ x R. 
// 

(1.17) |w| < C and |Vw| g < Co on O x 

for some constant Co, then, for any open set 2 of M. satisfying 2 C Q\, 

|V 2 w| 9 < C on0 2 

for some constant C depending only on n, Cq, g, (/, F), ip, 7], 0\ and G 2 . 

Both Theorem 1.3 and Theorem 1.5 are used in the proof of Theorem 1.2. 
In section 4 we establish C 2 estimates on general manifolds with umbilic 
boundary, without any locally conformally flat assumption, for the following 
Monge-Ampere type problem 

( detig- 1 ■ U) = e' 2nu , X g (U) G T n on O u 

(1.18) <^ 

[ |H = ce ~u _ hg Qn 0l p, Q M 

where U is defined by (1.11). 

Theorem 1.6. Assume that (Ai,g) is a smooth compact Riemannian man- 
ifold with smooth umbilic boundary DM.. Let 0\ be an open set of M. and 
let u e C 4 (Ci) be a solution of (1.18) with c> 0. // 

(1.19) |u| < C and \Vu\ g < C on O x 

for some constant Co, then, for any open set O2 of M. satisfying 2 C 0\, 

|V 2 m| 9 < C on0 2 
for some positive constant C depending only on n, c, g, Co, 0\ and 2 . 

The Dirichlet problem for equation (1.8) has been studied in [16] for 
(/, T) = (a k , Tfc) and the existence of solutions is established whenever there 
exists an admissible supersolution. A similar problem for (/, T) = (o~ n , T n ) 
was studied in [34]. The Neumann problem for Hessian equations has been 
studied in [33, 41, 44, 10, 35], most of the works are for Monge-Ampere 
equations. The results in [41] and [44] concern, respectively, general Hessian 
equations on Euclidean balls and on general domains in dimension two. 

We draw readers' attention to some closely related independent work of 
Sophie Chen in [8]. 

2. Gradient estimates 

In this section we will prove Theorem 1.3 and Theorem 1.4 concerning 
gradient estimates for solutions of (1.14) and (1.16). We use the distance 



-d g {x,dM) = l ondM. 



function d g (x,dAi) in (Ai,g) to the boundary dAi. Clearly there is a suit- 
able small constant 5q > such that d g (x,dAi) is smooth in {x G M. : 
d g (x,dM) < 25 }. Moreover 

d_ 
dv 
We will fix a positive constant C\ such that 

(2.1) U(X, X) > -C ig (X, X) for X G T(dM). 

It is well-known that we can always find a metric conformal to g with 
vanishing mean curvature on dAi. Since a conformal change of metrics does 
not affect our C 1 and C 2 estimates, without loss of generality, in sections 2-4 
we always assume that h g = on dAi in the arguments. 

Proof of Theorem 1 . 3. By shrinking 2 if necessary, we can always choose a 
cut-off function p G Cg°(0i) such that 

(2.2) 0<p<linCi, |Vp| <Cy/piaO u p = 1 on 2 
and 

(2.3) ^ = on 0i n dM if 0i n dM ^ 0, 

where C is a universal constant. 
Let 

7 (t):=|(l + t-a)- A , te[o,6], 

where the number A is large enough so that A/(l+6— a) > 8. Then we choose 
a function ip G C°°(A / 1) such that <p(x) = d g (x,dAi) when d g (x : dAi) < e , 
where < eo < 5o is sufficiently small. Since -u satisfies (1.15), we may 
further assume that <p is chosen in a way so that 

(2.4) \r} u cp\ < - and \r} uu cp\ < - on M x [a, 6]. 
We now consider the function 

G:=^pe a \Vu-pV V \ 2 g on 0i, 

where 

a(x) := A<^(x) + 7(w — 77(2;, u)ip), (5{x) := r^(x, m) 

and A is a large number to be determined later. In order to derive the desired 
bound on |Vw| s over 2 , it suffices to show that G can be bounded in 0i by 
some universal constant C depending only on n, (/, T), g, if;, r\, a, b, 0\ and 
02- Suppose the maximum of G over 0\ is attained at some point xo G 0i. 
In the following we will always assume that G(x ) > 1; otherwise we are 
done. 

We first claim that xq must be an interior point of 0i, i.e. xq G 0\\dAi. 
To this end, suppose xq G <9.M and choose an orthonormal frame field 



{ei, • • • , e n } around xq such that e n = v on dM. In the following for any 
smooth function we use (pi, <pij, • • • to denote the covariant derivatives of <j) 
of all orders. It is easy to see that on dM there hold 

tp n = 1, y?/ = and tp ln = (p nt = for 1 < / < n - 1. 

By using the boundary condition w n = i](x,u) we thus have on <9.M that 

ra-l 



1 1 

u n -/ty n = and G=-pe^|Vw-/3V^ = -pe 7 WJ] 

Therefore, since p n = on Oi H dM, 

n 
G n = pe l{u) ^(^ - PW) ( U ^ - Pnfl - P<Pln) + Ga 



1=1 
n-1 



pe^Y, u iUni + \G. 



i=i 
By using again the boundary condition u n = f](x,u) on dM we have 

n— 1 

«n« = ej(u n ) - cfo (V e ,e n ) = e;(??) - ^(V ei e„, e k ) g u k 

k=i 

n-l 

= m + VuUi + ^2 n ( efc ' e «) Mfc - 
fc=i 

Consequently, by using (2.1), (1.15) and the fact G(xq) > 1 we can choose a 
large universal number A such that 

71—1 71—1 

G n (x ) = pe 7(u) Y^ n ( e fc> ei)u k ui + pe 7(u) ^(77, + r] u Ui)ui + AG 

k,l=l 1=1 

n—1 

>(\-2C 1 -2\ Vu \)G + pe^Y,ViUi 

i=i 
>0. 

However, by the maximality of G(x ) we have G n (xo) < 0. We thus derive a 
contradiction. 

Therefore Xq G 0\\dM. Choose normal coordinates around xq such that 

(2.5) (Uij) = I Uij + UiUj - -\Vu\lgij + (Ag)^ j 

is diagonal at Xq. Then, by setting £i = Ui — /3tpi, we have at x that 

(2.6) = G t = pe a V (u u - (3 m - (3ip u )) & + a t G + P -G 

, P 
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and 



> (G y ) = ((a, - a^G + mz2tEL G - a ^ + a ^ G 

+ pe a ^ ( u Hi ~ Pij<Pl ~ PiPlj - PjfU ~ PWij) & 

I 

(2.7) + pe a ^ ( u n - PMi ~ PVu) ( u ij - PjW ~ PVij) ) • 

i 

Let i™ := -jj^-(U). It is well-known that (i™) is positive definite and F l 
fiSij at Xq (see [4]). It then follows from (2.7) that 



> e~ a F ij G 



.2 



= e~°G J2 /i(«« " «?) + e" Q G £ / / Pii 2 2p? - 2 e -°G £ /^ 

i i i 

id 

i,l 

(2.8) > ipKI 2 £ /,(<*« - af) -\£\ 2 J2 Si*** ~ CT \tf + *, 

i i 

where 

£ ■= p^fi ( u m - PuVi - Wwu - Pviu) 6- 
i,i 

Since G(xq) > 1, we have |Vw| < C\C,\ for some universal constant C. Note 



that 



/3i = Vi + VuUi and /^ = ?fe + 2r] iu Ui + r} uu u\ + 77^1%. 

By using Ricci identity um = um + R r mu r , where Rijki denotes the Riemann 
curvature tensor of g, we have 

£ > P ^2 fo U ™& ~ P^u ^2 fi U ™Vlil ~ CpT\£\ 3 . 
i,l i,l 

By the degree one homogeneity of / and (2.5) we have 

-PVu^2fiUii(p& > -CpT\£\ 3 . 



■1.1 
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Therefore by using (1.14), (2.6) and the fact |Vp| < C^fp we have 

s>pJ2f* u ^- c P T \z\ 3 

i,l 

= <°E f* ( U « - u " + \\*u\ 2 gii ~ (A,k) ii - CpT\tf 

> -2p E fi U U U & + P T E W « U *& ~ CpT\^\ 3 

i,l k,l 

> -2p E f* ( U K ~ PiW ~ ^«) & U i 

i,l 

+ pT^2 ( u ik ~ Pk^i - P^ik) iiu k - CpT\£\ 3 

k,l 

= Kl 2 E f^P a * + P*) - \ T \^ E Mpuk + Pk) - CpT\tf 

i k 

> p|£l 2 E f^ a * - Ip t ^ 2 E u ^ - c Vp t \Z\ 3 - 

i k 

Plugging this estimate into (2.8) we have 

> -p|£| 2 E fi( a H ~ Q . ? ) + P\£\ 2 E ^ iUi(Xi ~~ l^ 2 E ^ aiPi 
i i i 

-\p\Z\ 2 TY,UkOt k -C^pT\Z\\ 

k 

Note that 

(Xi = \<Pi + i ((1 - 11 u (p)Ui - 7}i<p ~ Wi) 

and 

an = M>u + 7" ((1 - r] u if)Ui - 77^ - r/c^*) 2 

+ i ((! - Vu¥)uu - riuu^u 2 - 2r) iu Ui(p - 2r) u Ui(pi - rjutp - 277^ - rjtpu) . 

It follows that 
> \p\i? E /*«* ( i-f - (V) 2 ) (! " ^V? + 2V(1 - W>) - I'VuuV) 

i 

+ \p\i\ V(l - ^) E /<«« - ^7'TieH V«| 2 (l - 77^) - CVpT|£| 3 
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Note that u„ = Uu— w 2 +||Vw| 2 (fe — (A g )u. Using the degree one homogeneity 
of / we obtain 



> \p\tf J2 /*«? i (/ - (V) 2 ) (1 - VuV) 2 + 7(1 - *,¥>) ~ 7 W} 

i 

- P1 'T\i\ 2 \Vu\\l - Vu <p) - C^ P T\tf 



2' 
1 
~4' 
From the definition of 7 and (2.4) one can verify that 

(7" - (if) (1 - Vuff + V(l - Vu<p) - j'vuuf > and 7 , <-c <0. 

Thus 

> copT|e| 2 |V M | 2 - Cv/pT|£| 3 > CoP T|e| 4 - CypT|£| 3 . 
This gives the desired estimate. □ 

Before giving the proof of Theorem 1.4, let us recall the condition (H a ) on 
(/, T) introduced in [26]. 

Definition 2.1. We say (/, T) satisfies condition (H a ) for some a > if there 
exists some positive constants e± and c\ such that for any (A,£) G T x M n 
satisfying 



M^~^| 2 



<e x \if for 1 < i < n, 



f(X)<a, \Z\>e^ and 
there holds 

i:/i(A)|(A,+|iei 2 -4 2 ) 2 +c 2 (ier-^ 2 )| > cl !ei 4 i:/,(A). 

Some discussions have been given in [26] on the condition (H a ) for (/, T). 
Here are two remarks. 

Remark 2.1. (i) It is easy to check that if / is homogeneous on T, then 
(/, r) satisfies the condition (Hi) if and only if (/, T) satisfies the condition 
(H a ) for each a > 0. 

(ii) From the proof of [19, Lemma 2.4] and [20, Theorem 3], one can see 
that the following two classes of (/, T) satisfy the condition (H a ): 

(f,T) = (al /k ,T k ) withl <k<n 

and 

(f,T) = ((a k /a l ) 1 /^ l \T k ) 

with < I < k < n and (n - k + l)(n - I + 1) > 2(n + 1). 
Proof of Theorem I.4. Consider the function 

G := -pe Xip \Vu - ce- u V^\ 2 g on O u 
2 y 
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where <p and p are as in the proof of Theorem 1.3, and A is a fixed positive 
constant satisfying 

A > 2Ci + 2\c\e Co . 

We need to show that G can be bounded by some universal constant C 
depending only on n, c, (/, T), g, Co, 0\ and O2. Suppose the maximum of 
G over 0\ is attained at some point Xq G Q±. In the following we will always 
assume that G(x ) > 1. 

Similar to the proof of Theorem 1.3 we have xq G Oi\dM.. As before we 
choose normal coordinates around Xq such that (Uij) is diagonal at x . Then, 
by setting £1 = Ui — ce~~ u ipi, we have at xo that 

(2.9) = G % = pe Xip J2 K ~ ce ~ U (Vn ~ w)) ii + \G Vl + P -G 
and 

> (o«) = ((Aw, - aWj)g + ""^"" g - «i»« 

(2.10) + pe v Y^ { u n ~ ce ~ U (Vn - <PiUi)) (uij - ce- u ( Vlj - <p lUj )) ) . 

It then follows from (2.10) that 

(2.11) > e-^F^Gij = 1 + 11- -TG. 

where 

I := p^fi (uiu - ce~ u {ip Hi - 2(p ti Ui - <piuu + (piuf)) &, 

i,l 



i,l 

Similar to the estimate for £ in the proof of Theorem 1.3, we have by (2.9) 
that 

(2.12) / > pV/,^, - -^TG§ > ~TGl 

Xi Vp Vp 

For the term II, by using the elementary inequality 

(2.13) (a + bf > -a 2 - b 2 for any a,beR 
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we have 



1 
11 - oP E f^ Uli + (A?)h) 2 -P^fi {(Ah + ce~ u &ii ~ <PiUi))' 



i.i 



1. 1 



>IpJ2m u »+( a 9 )h) 2 - ctg - 



i,l 



Using (2.5) we then obtain 



II =^pY,h(uu + \\Vu\ 2 g g H -u l u)\ -CTG 
i,i ^ ' 

(2.i4) =ip^/J^ + I|v^-^y + ^(|v^-^)|-c'rG. 



Let £ = (£i, • • • , £ n ). By using the elementary inequality (2.13) once again, 
we have 

+X)/*Wi v «i;-«?)-^(iei 2 -^)) 



It is easy to see that 

1- ,2 i 

2'""' 9 2 



v<-^| 2 -« 2 + £ 2 



<C(l + |Vw| p ) <C\i\ 



and 



i«?(iv«i; - «?) - m\ 2 - ai < c(i + iv«i;) < ciei 3 - 



Consequently 



12 2 1 i 2/lw 12 2 






This together with (2.14) implies that 



(2.15) //>^E^{(^ + ^^-^) 2 + ^^ 2 -C 2 )}-^Gf. 
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Combining (2.11), (2.12) and (2.15) yields 



(2-16) P^/,|(^ + i|e| 2 -C 2 ) 2 + C 2 (ie| 2 -a|<^Gl + ^TG. 

In order to apply the (H a ) condition on (/, T) with A, = Uu and £j = Uj ■ 
ce~ u ipi, we need to check 



(2-17) 



ii[Uu-^\ 2 



<eM 



To see this, recall that (Uij) is diagonal, one has 

By using (2.9) we have 

C 



Ee 



Z«i« 



^6 (w/i - ce U ((/?h - </?j«j)) 



+ qei 2 <^iei 2 - 



Moreover, by direct calculation one can see that 



J^6 hiiUi - -|Vm|^J - -£ 



\Zv 



<C{l + \Vu\l)<C\ti\ 2 . 



Consequently we have 



Siiu, 



■M 



<^\ 2 <^\ 3 <e^\ 3 . 



if we further assume that G(xq) > C 2 je\. Therefore we may apply the (H a 
condition on (/, F) to (2.16) to get 



C 



c. 



c. 



cipTI^I 4 < — TG5 + —TG <-T[G^ + G). 



yfP 



P 



P 



Consequently G 2 < C(Gi + G) which implies G(xq) < C for some universal 
constant C. □ 

3. C 2 estimates: general equations 

The aim of this section is to show Theorem 1.5. We may assume 0\ D 
dM. 7^ since otherwise the results follow from the well-known local interior 
estimates (see [19, 26]). Without loss of generality, we may also assume that 
g is conformally flat on Oi, i.e. there exists a function (p e C°°(Oi) such that 
e 2v g is a flat metric on 0\. Since 0\C\dM is umbilic in g, it is also umbilic in 
the flat metric. Therefore 0\ fl dM is either a part of a hyperplane or a part 
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of a sphere in R™. By shrinking 0\ and using the conformal diffeomorphism 
in R n if necessary we may assume that 

O x = BX := {x = (xi, ■ ■ ■ , x n ) G R n : \x\ < 4 and x n > 0} 

and 

Oi n OM := OBi n {x„ = 0}. 

Observe that e 2( - u+ ^g is also a flat metric, By using the conformal invariance 
the function v :— u + ip satisfies the following problem 

f F(V) := f(X(V)) = 4>(x, v), X(V) E T in 5+, 

(3.1) <^ 

{ v n = fj(x, v) on dB\ n {x n = 0}, 

where ip(x,v) = ip(x,v — (p)e~ 2<p , fj(x,v) = r](x,v — ip)e~ 2ip , V denotes the 
matrix function 

V := D 2 v + dv®dv \Dv\ 2 I, 

I is the n x n identity matrix, D is the standard connection on R n , Dv and 
D 2 v denote the gradient and Hessian of v respectively, and X(V) denote the 
eigenvalues of V. 

Recall that we can assume h g = on dAi. So ip n = on dB^ fl {x n = 0}. 
Therefore when i] = and -^ = on (9.M x R, we have ?] = and ip n = 
on d-B^ fl {x„ = 0}. Thus, in order to show Theorem 1.5, it suffices to prove 
the following result. 

Theorem 3.1. Assume that (f, T) satisfies (1.1)-(1.6) and that if), r) satisfy 
one of the following conditions: 

(i) t) = and $ n = on (dB+ n {x n = 0}) x R and $ e C 3 (B+ x R); 
(ii) fj is positive and ip is any function. 

If v E C 4 (BX) is a solution of (3.1) satisfying 

(3.2) \v\ < C and \Dv\ < C in B\ 
for some positive constant Cq, then 

(3.3) \D 2 v\ <C in B+ 

for some positive constant C depending only on n, Cq, (f, T), ip and fj. 

Proof of Theorem 3.1 under condition (i). This case can be reduced to the 
local interior estimates. To this end, we define 

v(x',x n ), when x n > 0, 

(3.4) v(x',x n ) 

v(x', —x n ), when x n < 
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and 

{ip((x',x n ),t), when x n > 0, iEl, 
_ 
ip((x' : —x n ),t), when x„ < 0, i6l. 

Since v n (x',0) = and ijj n ((x', 0), t) = 0, it is easy to see v G C 2 (-B 4 ) and 
$ G C 2 ' l {B A x R). Let 

V := D 2 w + dv®dv \Dv\ 2 I. 

By direct calculation one can see that 

{V(x',x n ), when x n > 0, 

QV(i',-i n )Q, whena; ra <0, 
where Q is the orthogonal matrix Q := diag[l, • • • ,1, —1]. Therefore 

(3.5) F(V):=f(\(V))=$(x,v), \(7) G T in B 4 . 

It then follows from [15, Lemma 17.16] that v G C 4,a (B2) for any a G (0, 1). 
Now the local interior estimates in [26] can be applied to obtain \D 2 v\ < C 
in Bi for some constant C depending only on n, Cq, (f, T) and ■?/>. This in 
particular implies (3.3). □ 

Remark 3.1. Note that the function v defined by (3.4) satisfies (3.5) and 
has uniform C 2 estimates. Since / is concave, by Evans-Krylov theory and 
Schauder theory we can obtain uniform estimates on ||^||c 4 ' a (Bi/2) f° r anv 
a G (0, 1). Therefore, for a solution u G C 2 (Ai) of (1.14) with ip and i] 
satisfying (i) in Theorem 1.5, if (1.17) holds then 

IMIc 4 .«(e> 2 ) ^ C 
for some constant C depending only on n, C , a, (/, T), ip, 0\ and 2 - 

Next we will prove Theorem 3.1 under condition (ii). We will use {ei, • • • , e n } 
to denote the standard orthonormal basis in M n , i.e. e, = (0, • • • , 1, • • • ,0), 
where 1 is in the ith spot and elsewhere. The following result gives the 
double tangential derivative estimates without any restrictions on ip and rj. 

Lemma 3.1. Assume that (/, T) satisfies (1.1)-(1.6). If v G C 4 (B A ) is a 
solution of (3. 1) satisfying 

(3.6) |i>| < Co and \Dv\ < Cq in B£ 

for some positive constant Co, then there exists a positive constant C\ de- 
pending only on n, Cq, (f, T), ip and fj such that 

(3.7) v TT < d in fi 3 + 
for any vector r G span{ei, • • • , e„_i} with \r\ — 1. 
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Proof. By rotation it suffices to establish (3.7) for r = e\. Let p G C^°(B4) 
be a radial cut-off function such that < p < 1 in M. n , p = 1 in B 3 , and 
I -Dp I < ^p 5 i n -B4. Consider the function 

if = pe^» ( Un + vl) onB 4 + , 

where /3 is a large positive constant to be determined later. Suppose the 
maximum of H over B\ is attained at some point Xq, then either xq G 
B\ fl {rc„ > 0} or £0 G -B4 H {x„ = 0}. In the following we will always assume 
that H(xo) > 1 and Vn(x ) > 1; otherwise we are done. 

Let us first calculate H n on 5 4 n{a;„ = 0}. Since p is radially symmetric, we 
have p n = on x n = 0. Thus, by using the boundary condition v n = fj(x, v), 
it is easy to see that 

H n = p (v n„ + 2wiwi n + f3(v n + f 1)) 

= p((f3 + fj v )v u + (P + fj vv + 2f] v )v\ + (2^ + 2t7i v )ui + 7711) . 

If xo G -B4 fl {rc n = 0}, then, using (3.6) and vu(xq) > 1, we have H n (xo) > 
by choosing /3 large enough. But by the maximality of H(xq) we have 
H n (x ) < 0. We thus derive a contradiction. Therefore xo G -B^ fl {x n > 0}. 
Now at Xq we have 

(3.8) = Hi=(^- + (35^ H + pe^ {v lu + 2v 1 v li ) , 1 < i < n 



and 



> W) ) = { piz^i n _ ^^ _ ed*±e*ipH 



+ 



pe pXn (v Uij + 2uiv Mj + 2ui i uy)). 



Let i™ := ^(V) and T := J2 i F ii . We know that (i™) is positive definite 
and T > /(l, • • • , 1) > 0, Thus we have at £0 that 

> e-P Xn F ij m 



L v 



= c -^ x ^HF ij PPij ~ iPj - 3 2 e~ l3xn HF nn - 23e~ l3xn HF in — 
' P 2 ' P 

+ pF t] (viuj + 2v 1 v lij + 2v li v lj ) 
(3.9) > --TH + pF* (vmj + 2v lVlij + 2v u v lj ) 

By differentiating the equation (3.1) twice and using the concavity of F we 
have 

F lJ (vijk + 2v ik Vj - ^^ v i v ik8ij) =^k + ipvVk, 1 < k < n 
1 



19 

and 

F lJ (vijii + 2vinVj + 2vuVji - ^(vivm + vf 1 )5 ij ) 

i 

> ipii + 2t[ji v vi + ip vv vl + $ v v 11. 

Therefore, by using (3.8) and (3.6), 

C 

pF ij v ijU > -2pF ij ( Vill Vj + vnVjx) + P T Y1 ( VlVlu + v n) TH 

i P 

> ApviF^vuVj - 2pTv x y^ vivn - 2pF lJ v il v jl 

i 

(3.10) +pT J2vl--TH. 

i P 

By using (3.1) and (3.6) we have 

2pF ij v 1 v lij = 2pv 1 F ij (v ij - v iVj + -\Dv\ 2 Si^ 

= 2pvi(i)i + i) v vi) - ApviF^vuVj + 2pv 1 T^2vnV[ 

i 

C 

(3.11) > -Ap Vl F ij v llVj + 2p Vl T J2 vnvi TH - 

Combining (3.9)— (3.11) yields 

o > -C TH + pT y v 2 > _C TH + pTv 2 > _ c l TH+ l _ TH 2 
p *-f p p p 

Consequently, we have H(xq) < C, and the proof is complete. □ 

Lemma 3.2. Under the hypotheses of Theorem 3.1 with (ii) satisfied, there 
exists a positive constant C depending only on n, Co, (f, F), ip and fj such 
that 

(3.12) \v n n(x',0)\ < C whenever \x'\ < 2. 

Proof. It is convenient to consider the function w := e v . By direct calculation 
and the degree one homogeneity of F it follows from (3.1) that w satisfies 

( F(W):= f(X(W)) = ^(x,w), X(W)eF in 5+ 

(3.13) 1 

y w n — fj(x, w) on dB~l fl {x n = 0}. 

where ip(x, w) = wip(x, logw), fj(x, w) = wfj(x, logiu) and 

W :=D 2 w-—\Dw\ 2 L 

2w ' 
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Moreover, by using (3.2) one can see that there is a positive constant C 2 
depending only on Cq such that 

(3.14) — < w < C 2 and \Dw\ < C 2 in B\. 

C2 

We now introduce a linear elliptic differential operator C on B\ by 

£0 = Fifaj - w~ l T J2 ™i<t>h V0 G C 2 {Bt). 

1 

where F lj := -^-(W) and T := ^ F n . Recall that (F tj ) is positive definite 
and T > /(l, • • • , 1) > 0. By differentiating the equation (3.13) with respect 
to x n we obtain 

1 



™ 



w 



w 1 wiWi n 5 ij + -u; 2 w n \Dw\ 2 5 ij = t[j n + t[j w w n . 



ijn "J "Jl^ln^tj 1 „ "J <J->n\ J -" JJ \ u ij 



Thus 

C Wn = i, n + ^ wWn -\ W - 2 Wn T\ Dw \ 2 . 

By using (3.14) and the degree one homogeneity of / we have 

\Cfj\ < \fj w F ij Wij \ + CT <CT in Bf. 
Consequently 

(3.15) \C(w n -fi(x,w))\<CT inB+. 

Next we consider the function w n . Since \{W) G V C I\, we have Aw > 
in S4". Therefore from Lemma 3.1 it follows that 

n— 1 

w nn > - ^ lUii > -(n - l)Ci in £^\ 

i=i 

Since 77 is positive, we have 57 > 2«o on dB^ fl {x n = 0} for some universal 
constant «o > 0. Therefore 

w n (x', x n ) + (n — l)CiX n > w n (x', 0) > 2a for (a/, x n ) G B~£. 

Thus there exists a universal constant < £0 < 1 such that 

(3.16) w n (x',x n ) > 0:0 > for (a;', x n ) G -B^ fl {x n < eq\. 

In order to establish (3.12), it suffices to show that |u> n „(0)| < C for some 
universal constant C . Consider the function 

= Ax n + B\x\ 2 ± (w n — rj(x, w)) on 5+, 

where A and 5 are sufficiently large positive constants to be chosen below. 
Clearly on dB+ Q fl {x n = 0} we have > since w n — fj(x, w) = there. 
Also, by using (3.14) we may choose B large enough so that > on 
dB+ n {x n > 0}. Thus 

(3.17) 0>O ondB+. 
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With the number B chosen above, by using (3.14), (3.15) and (3.16) we have 
C(p = —Aw~ 1 w n T + BC{\x\ 2 ) ± C (w n — fj(x, w)) 
< -AC^a T + CT 
(3.18) <0 

in Bf o if we choose A large enough. 

By the maximum principle, it follows from (3.17) and (3.18) that > in 
.B+. Since 0(0) = 0, we therefore have n (O) > 0. consequently |u> n „(0)| < C 
for some universal constant C. □ 

Proof of Theorem 3.1 under condition (ii). Consider the function 

G(x, = p(x) (v^(x) + (Dv(x), 2 ) , VxGB+and(G S n , 

where p G C^(B2) is a radial cut-off function such that < p < 1 in M n , 
p = lonBi, and \Dp\ < Cp^ in B2. Suppose the maximum of G over B^ x§ n 
is attained at (x, £), then either x G B% fl {x n > 0} or x G B 2 fl {x„ = 0}. 

If x G -B^~ fl {x„ > 0}, then similar to the proof of [26, Theorem 1.20] one 
can show that G(x, £) < C for some universal constant C. If x G B2 fl {rr n = 
0}, we may write £ = ae n +/3r, where r is a unit vector in spanjex, • • • , e n _i}, 
and a and /3 are two numbers satisfying a 2 + j3 2 = 1. Then 

i£f = a 2 t>„„ + /?Vt + 2a/3v nT . 

Since t>„ = fj(x,v) on a;„ = 0, we have v nr = fj T + f\ v v r which is bounded. 
Therefore it follows from Lemma 3.1 and Lemma 3.2 that vg < C at x and 

hence G(x,£) < C for some universal constant C. 

The above argument shows that v^ < C in 5J 1 " for any unit vector £ G § n . 
Since At> > 0, we also have v^ > —C in B± for any £ G § n . Therefore 
\D 2 v\ < C in 5+. " D 

4. C 2 estimates: Monge-Ampere type equations 

In this section we prove Theorem 1.6. We first have the following double 
normal derivative estimates. 

Lemma 4.1. Under the hypotheses of Theorem 1.6, there holds 

|V 2 w(z/,z/)| <C ond0 2 nM 

for some positive constant C depending only on n, c, g, C , 0\ and 2 . 

Proof. Recall that we assume h g = on dM. and that d g (x, dM) is smooth 
in Ms := {x G M : d g (x, dM) < 5q}. We may extend the unit inward 
normal vector field v to a smooth vector field in Ms , still denoted it as z/, 
by parallel translating along the unit-speed geodesies perpendicular to dM. 
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Clearly V \v = in M.& . Thus along any such geodesic 7 starting from a 
point 7(0) G Ox fl <9.M we have 

— (u„( 7 (t))) = i/(u„) = V 2 u(u, v) + du(V^) = V 2 w( z/, z/). 

Since \ g {U) G r n , we have 

1 

2' 

Therefore it follows from (1.19) that there is a universal constant C\ such 
that 4 (-Uy(7(t))) > — Ci as long as 7 is in C^. Consequently 

uu(l(t)) > u„( 7 (0)) - Cid fl ( 7 (t),9M) = ce- u (^°» - Cid ff ( 7 (t),9M) 



V 2 w(z/, z/) + w 2 ~ -| V«|J + A fl (i/, v) > 0. 



as along as 7 is in C^. Fix an open set 3 of M. such that 2 C O3 and 
O3 C 0\. Since c > and u < Co in C?i, there exist universal constants 
< S\ < So and ao > such that 

(4.1) u u >a m0 3 (~)M Sl - 

Now we are going to introduce a linear elliptic differential operator C u on 
M.. Since X g {U) G r„, we can define a tensor f/^ 1 on Ai, which in local 
frame has the representation U~ l = {£/'■'}, where U^Ujk = S\, and {C/^} 
denotes the local representation of U. We define 

C u tP := t/^- - tr^tr^Vu, W>> 9 , W> G C 2 (.M). 

At the end of the proof we will show that for the local function u v — ce~ u 
there holds 

(4.2) \C u {u u - ce~ u ) I < C (1 + tr^/y- 1 )) in .M 5l n O x 

for some universal constant C. 

We now fix a point rco G O2 H <9.M and consider the function 

V» = A<p + Br] ± (wj, - ce~") , 

where A and -B are two large positive constants to be chosen below, <p(x) = 
d g (x,dA4), and r\ := d g (x, Xq) 2 . We can choose a universal constant < 
S 2 < 5i such that Os 2 (x ) := {x E A4 : d g (x,x ) < S 2 } C 3 fl .M^ and 77 is 
smooth in (9,5 2 (x ) with 

I ?7 1 C3(0, 2 (xo)) ^ ^ 

for some universal constant C independent of Xq. 

Let us do some calculation first on tp. Choose a local orthonormal frame 
field {ei, • • • , e n } around x such that e n = v in M.s 2 . Then p n = 1 in .M^. 
Since p satisfies the Hamilton- Jacobi equation |Vp| = 1 in M.$ 2 we have 
Pi = in Ais 2 f° r 1 < i < n — 1. Therefore in Ais 2 there hold 

(p n — 1 and <pi = for 1 < 2 < n — 1. 
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This together with (4.1) implies that 

(4.3) (Vw, Vy?) 9 = u n >a in0 3 nMs 2 . 
By direct calculation we can see that on dM. there holds 

{-n(e i ,e i ), l<i,j <n-l, 
-h g , i = j = n, 

0, otherwise. 

Since dM is totally geodesic in (M,g), we have V 2 y? = on dM. Therefore, 
one may choose a universal constant < S% < 62 such that 

(4.4) VV < 2«o^ in M S[i . 

Returning to the function ip. Since u v — ce~ u = on dM, we have ip > 
on dM fl Os 3 (x ). Since 77 > <5f on 90^ (x ) fl (M\dM) and since w and 
|Vw| are bounded, we also have ip > on dOs 3 {xo) fl (.M\<9.M) by choosing 
B large enough. Therefore 

(4.5) ^>0 ondO^Xo). 
In the following we will show that 

(4.6) C u ^j<0 mO h (x Q ) 

if A is chosen large enough. It is clear that C u {rj) < C (1 + tr 9 (f/ -1 )). This 
together with (4.2) gives 

C u ^j = AC u ip + B£ u r) ± £„(«„ - ce 

^AC^ + Cil + tigiU- 1 )). 

But from (4.3) and (4.4) it follows that 

C u ip = XTitpij - tvgiu-^ivu, v^)< 
1 

2* 



-,—U\ 



< -aotigiU- 1 ) - aotTgiU- 1 ) 



< -^aotigiU- 1 ). 



Therefore 



Cui> < -^AaotigiU- 1 ) +C(1 + tTgiU- 1 )) in O 5a (x ). 
Note that 

tr^tr 1 ) > ndet(g • [T 1 )™ = ndet^ 1 • */)"» = ne 2u > (3 > 
for some universal constant j3q > 0. Thus 

£„V < -^Aaotr^f/- 1 ) + Ctr^f/- 1 ) < in O^o) 
if we choose A large enough. 
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By the maximum principle it follows from (4.5) and (4.6) that ip > in 
0$ 3 (xq). Since ip(x ) = 0, we therefore have ip u (x ) > 0. Consequently 
|V 2 m(z/, v)\(xq) < C for some universal constant C . 

In order to complete the proof, we still need to prove claim (4.2). Fix a 
local orthonormal frame field {ei, • • • , e„} with e n = v. For the local function 
u v it is easy to check 

{u v )ij - u nij = T k n u kj + T k jn u ki + b k jU k , 

where 

Tjj = (V^e,-, e k ) g and 6^ = ej(T in ) + r j7 r in — T^Y ln) 

they are all bounded functions. Recall the commutation formula u n ij — Uij n = 
RikjnUk, we therefore have 



\"'v)ij u j ijn 



T k n u kj + T k n u ki + (&£ + i? ifcjn K 



Noting that (Wj,)j = ttz n + Ff n ii k , we thus have 

£«(«„) = (^'wijn - tr^c/- 1 )^^) + 2r^^« fcj 

+ (&£■ + i2i fc ,-„) £/*'«* - tr^IT 1 )!* u,u fc . 

By taking logarithm on equation (1.18) and then taking covariant differenti- 
ation, we have 

Consequently 

Cu{u„) = -2nu n + XT 3 (2T k n u kj - 2u in u j - (A g ) ijtn ) 

+ (&£■ + R lk]n ) U lj u k - tr g (U- l )T k n uiu k . 

Since (IT 13 ) is positive definite, we have \U l3 \ < Ctr fl ([/ -1 ). Using the fact 
U lJ Ujk = 5 l k , the relation between U^ and u^ and the boundedness of |Vw| fl , 
one can see that 

\U tJ u k3 \ + \U ij u in \ < C (1 + tigiU- 1 )) 

Therefore 

|A.K)I < c (1 + tr^t/- 1 )) in M 5l n 0l 

By direct calculation we also have 

C u (e~ u ) = -e- u U ij u tj + e- u U i3 Ul Uj + e~ u ti g (U- l )\Vu\ 2 

Hence 

\£u(e~ u )\ <C(1 + tigiU- 1 )) in M Sl n G 1 . 
Putting the above two estimates together, we therefore obtain (4.2). □ 

Theorem 1.6 now follows from the combination of Lemma 4.1 and the 
following result which provides more information than what we really need 
to complete the proof of Theorem 1.6. 
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Lemma 4.2. Assume that (/, T) satisfies (1.1)-(1.6) and that (Ai,g) is a 
smooth compact Riemannian manifold with smooth umbilic boundary dAA. 
Let 0\ be an open set of At and let u G C A (Oi) be a solution of (1.16). If 

(4.7) |u| < Co and \Vu\ g < C in O x 
and 

(4.8) V 2 u(u, v) < C on O x n dM 

for some constant Co, then, for any open set 2 of M satisfying 2 C Q\, 

|V 2 m| 9 < C %n0 2 
for some constant C depending only on n, c, Co, g, (f, T), 0\ and 2 . 

Proof. Consider the function w := e u . Recall that h g = on dM, from 
(1.16) it is easy to check that 

F(W) := f(\ 9 (W)) = w~\ X g (W)eT in O u 



(4.9) 
where 



§^ = c ondn&M, 



W := V 2 w - — \Vw\ 2 g g + wA g . 



2w' 

Moreover, it follows from (4.7) and (4.8) that 

(4.10) Cf 1 <w<d and \Vw\ g < d in O x 
and 

(4.11) V 2 w(u, v) < d on Ox n dM 

for some positive constant C\ depending only on Co- Note that dM is totally 
geodesic in (M, g). Thus V T u = on dM for any r G T(dM). Since w u = c 
on dM, for any r G T(&M) there holds 

S7 2 w(v, r) = r(^) - dw(V T v) = 0. 

Now let U(Ai) denote the unit tangent bundle over AA and consider the 
function 

Q(0:=pe^«V W (£,0, teU(Ai), 
where 7r : TAi — *■ .M is the canonical projection, /3 > is a positive 
constant to be chosen below, tp G C°°(.A/f) is a fixed function satisfying 
¥>(s) = d g (x,dAi) in .M 5o := {x G .M : d g (x,d.M) < S }, and p G C%>(O x ) 
is a cut-off function satisfying (2.2) and (2.3). Suppose the maximum of Q 
over U(At) is attained at £ G T S .M for some x E O x . In the following we will 
assume that V 2 u>(£, £) > 1 since otherwise we are done. We have to consider 
two cases: either x G 0\ fl <9.M or x G C?i\d.M. 

Case 1. x G Oi fl <9.M. We write £ = az/ + /3r, where r is a unit vector 
in T s (dM) and a and /3 are two numbers satisfying a 2 + [3 2 = 1. Then by 
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using the maximality of V 2 u>(£, £) and the fact \7 2 w(v, r) = one can see 
that at x there holds 

V 2 u>(£, = a 2 V 2 w(u, v) + (3 2 V 2 w(r, t) + 2a[3V 2 w(v, r) 

<(« s +flv 2 4i) 
= v 2 w (e,e)- 

This implies that we can take £ so that either £ = z/ or £ G T(<9.M). 

If £ = z/, then (4.11) implies that Q(£) < C for some universal constant 
C. So we may assume that £ is a unit vector in T s (dAi). Choose a local 
orthonormal frame field {e±, • • • , e n } around x so that e n = v on <9.M, and 
write £ = C, l ei at x. We then define a vector field £ near x by £ = £*ej, where 
£ l (x) = £ for x near x. Note that £ n = near x. It is clear that £ is a smooth 
local section of U(M). Thus Q := Q(£) has a local maximum at x. This 
implies that 

Q n < at x. 
Set E = V 2 u>(£, £). Then, since p n = and </?„ = 1 on C?i fl dAi, we have 
(4.12) E n + (3E<0 at x. 

Observe that 

£« = v n (ee^o = ee^n + 2f v„e*% 

As calculated in the proof of Lemma 4.1, with the same notations as there 
we have for 1 < i, j < n — 1 

w nij = {w v )ij + T k n w kj + T k n w ki + b\jW k 

= T k n w kj + T k jn w ki + b%w k . 

By the maximality of Q(£) we have wu < CE at x for 1 < i < n. Since 
Aw > in M, we further have \V 2 w\ < CE at x. Thus £ n > -C 3 - C 4 E 
for some universal constants C3 and C4. This together with (4.12) implies 
that 

(f3 - C 4 )E < C 3 at x. 

Therefore E < C if we choose /3 > C 4 . Consequently (5(0 < C. 

Case 2. x G C?i\<9.M. Choose normal coordinates x 1 , • • • ,x n around x 
such that 

gij = Sij and — -^ = at x. 

Moreover, such normal coordinates can be chosen so that {i%} is diagonal 
at x and Wu = V 2 u> (£,£)• 

Consider the local function Z := Wu/gu. By direct calculation we have 

Zi = Wm and Z^ = Wmj at x. 
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It is clear that the function 

Q := pe^Z 
has a local maximum at x. Thus at x we have 

(4.13) = Q t = pe^w lu + (fin + -) Q 

and 
> (Qij) 

(p^ti - P <Pi<Pj)Q H "^ Q PQ + pe PV w Uij 



p< p 

8F_ 



Let i™ := ^t(W) and T := tr p (i™). Then using |Vp| < C^ and the 
inequality 

C ~ 
\wiuj — Wijn\ < C\V 2 w\ < Cwn < — Q. 

we have 

(4.14) > e-topiQij > pF lj w Ulj - -TQ > pF ij w ijn - -TQ 

By differentiating (4.9) twice and using the concavity of F we get 

F lJ w ijU - T (w' 1 ^^ w i w m + W 1 ^^ w n ~ 2uj2 ^2 w i w n w i 
i i i 

+ w~ 3 wl\Vw\ 2 w~ 2 \Vw\ 2 w n J + F ij (wuAij + 2w 1 A ij)l + wA ijA1 ) 

> —w~ 2 Wn + 2w~ 3 w 2 . 
This together with commutation formula and (4.13) implies that 
pF^Wiju > —CpTw n + pw^ 1 T\^wiWin + pw^ 1 Tw 2 1 



> —CpTw n + pw X T \^ wiWm + pw x Tw 



C 
> -TQ + pw- x 7w\ x . 

Thus, it follows from (4.14) that Q 2 < CQ. Consequently Q(f ) = Q(x) < C. 
The proof is complete. D 

5. Some existence results 

Let M. be a smooth compact manifold with smooth boundary dM.. We 
make use of the double M of M which is obtained by gluing two copies of 
M along the boundary dM. There is a canonical way to make M into a 
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smooth compact manifold without boundary [47]. Given a smooth Riemann- 
ian metric g on At, there is a standard metric g on At induced from g. In 
general g is only continuous on At. However, if dAt is totally geodesic in 
(Ai,g), then g is C 2 ' 1 on At, see [12, Appendix] for instance. 

5.1. Proof of Theorem 1.1. We may assume that (At,g) is not confor- 
mally equivalent to the standard half sphere W] since otherwise the existence 
result is obvious. 

First note that we may assume \{A g ) G T on At and h g > on dAt in 

4 

the following argument. To see this, consider the metric g £ := (1 — etp) n ~ 2 g, 
where e > is a small number, and tp G C°°(At) is a function such that 
tp(x) = d g (x, 9At) when d g (x, 9A4) < 5q. Since A(A 3 ) G T on At, we can fix 
an e > small enough so that A(A g J G T on A^. Then noting that tp = 0, 
9^ = 1 and /i 9 > on <9.M we have 

2d 2e 

Since R g > on At and /i s > on <9.M, one can find a metric go conformal 
to g such that i? ff0 > on AA and h go = on 97W, see [23, Theorem 0.1] for 
instance. Write g = e~ 2ip go for some function y? G C°°(A / 1). Let u G C°°(A1) 
be a solution of (1.10) with c = and let g := e~ 2u g. Then g = e~ 2v go with 

v — u + ip and /i^ = on 97V1. Let 7W denote the double of .M, and let g 
and g denote the standard metrics on At induced from g and g respectively. 
Since (9.M is totally geodesic in both (Ai,go) and (Ai,g), go and g are in 
C 2,1 (At). Moreover, g is still conformal to g with g = e~ 2v go for some 
function v G C 2,1 (7V1), and 

f(\(A e -2« go )) = 1, A(A e - 2 ^ ) G T on£ 

Since (At, go) is locally conformally flat, so is (Ai,go)- Note that R go > 
on AA and (,M,<?o) is n °t conformally equivalent to S n . Therefore, it follows 
from the proof of [27, Theorem 1] that 

|V0| < C and v > -C on M 

for some universal constant C. However, an upper bound for v is not yet 
available since we do not have X(A go ) G I\ Since v — v and v = u + tp on At , 
we have 

(5.1) |Vw| < C and u > -C on At. 

for some universal constant Co- 

Returning to problem (1.10) with c = 0. Suppose the minimum of u 
over At is attained at some point x G A\. Since h g > on <9.M, we 
have rr G A1\9At. Thus Vw = and V 2 u > at xq. Since A(A fl ) G F, 
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we therefore have e~ 2u > f(X(A g )) > 0. Consequently there is a universal 
constant C such that 

(5.2) minw < C 

M 

Combining (5.1) and (5.2) gives 

-C < u < C and |V«| < C on M. 
Therefore it follows from Remark 3.1 that 

ll M llc 4 .«(A4) < C 

for some universal constant C. 

Now we will use the degree theory argument to prove the existence. To 
this end, as in [26], for each < t < 1 let 

/ t (A):=/(tA+(l-t)<r 1 (A)e) 

which is defined on 

T t := {A G R n : tX + (1 - i)cr 1 (A)e G T} , 

where e = (1, 1, • • • , 1). 

We now consider the problem 

f t (X(A g J) = I, X(A gu )eT t onM, 

h gu =0 on M, 

where g u = e~ 2u g for some smooth function ttonA^. From the above argu- 
ment we have already obtained || , u||c 4 > c "(.a/1) ^ C f° r some universal constant 
independent of t. Now we set 

O; = {ue C 4 ' a (M) : X(AJ g r t , \\u\\c^ M ) < 2C, 

I fill 1 

- < / t (A(A fl J) < 2 on .M and — = on dMJ. 

Define F t : C t * -»■ C 2 ' a (A^) by F t [«] := / t (A(A s J) - 1. It follows from 
[31] that deg(F t , Of, 0) is well-defined and is independent of t. But when 
£ = the corresponding problem is the Yamabe problem with boundary. 
Based on [37] it was shown in [23] that deg(F , Oq, 0) = — 1. Therefore 
deg(Fi, Ol, 0) = — 1 7^ 0. The proof is thus complete. 

5.2. Proof of Theorem 1.2. The proof of Theorem 1.2 is based on some 
lemmas in the following. 

Lemma 5.1. Let (/, F) satisfy (1.1)-(1.6) and let (A4,g) be a smooth com- 
pact Riemannian manifold with smooth boundary d}A. Suppose dM. is um- 
bilic and (Ai,g) is locally conformally flat near dM.. Let u G C A (Ai) be a 
solution of (1-14) with rj being positive. If \u\ < Co on M., then 

|V«| + |V 2 w| < C on M 
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for some constant C depending only on n, Co, g, ip, i], and (/, T). 

Proof. This is the combination of Theorem 1.3 and Theorem 1.5. □ 

Lemma 5.2. Let (/, V) and (Ai,g) be as in Lemma 5.1 with \{A g ) G T on 
Ai and h g > on dAi. Then problem (1-14) with ij)(x,z) = ifjo(x)e az and 
i](x, z) = rjo(x)e bz has a unique solution, where a and b are positive constants, 
and i/jq G C 2 (Ai) and i]q G C 2 {dAi) are positive functions. 

Proof. By perturbing g as in the proof of Theorem 1.1, we may assume 
that \{A g ) G T on At and h g > on dAi. From the maximum principle, 
it is easy to check that there is a positive universal constant C such that 
— C < u < C on At for any solution u of (1.14) with ip(x,z) = ipo(x)e az 
and 7](x,z) = i] (x)e bz . Therefore, it follows from Lemma 5.1 and the result 
of Lieberman-Trudinger [32] that we have uniform C 2,a (Ai) estimates on u. 
Since a > 0, b > 0, ipo and 770 are positive, the linearized problem is uniquely 
solvable. Therefore, the method of continuity concludes the existence and 
uniqueness. □ 

Next we will use the recent results of Trudinger-Wang in [42] to establish 
a Harnack type inequality. 

Lemma 5.3. Let (Ai,g) be a smooth compact Riemannian manifold with 
smooth boundary dAi. Suppose <9.M is umbilic and (Ai,g) is locally confor- 
mally flat near <9.M. For k > |, let [g]^ denote the set of C°° metrics g 
conformal to g such that \(Ag) G L\ on .M and h g > on (9.M. // (Ai,g) 
is not conformally equivalent to the standard half sphere §", then there is a 
positive constant C depending only on k and (Ai,g) such that for any metric 
9 := X9 £ Wit, there holds 
(5.3) max x < C min x. 

M M 

Proof. Let [g\* k denote the set of metrics g conformal to g such that \{A g ) G T 
on .M and h g > on dAi. We remark that it suffices to establish the Harnack 
inequality (5.3) for g = X9 £ [<?]£■ Indeed, for any metric g = X9 £ [g\t > as m 
the proof of Theorem 1.1 we can find a function ip G C°°(Ai) with | < ip < 1 
on At such that tpg = (<px)g £ [<?]£■ Thus we have 

-maxx < max((/?x) < C max(ipx) ^ Cminx, 
2mm m m 

which gives the desired inequality. 

By a conformal deformation of g without loss of generality we may assume 

that h g = on <9.M. Since (9.M is umbilic, it must be totally geodesic in 

(Ai,g). Let .M be the double of At. For any metric g on At, there is a 

standard metric g on At induced by g. In general g is only continuous on 

7W. However, since (9.M is totally geodesic in (Ai,g), it follows from [12, 

Appendix] that g is C 2,1 on Ai. 
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For any metric g G [g\l, note that g is conformal to g, we may write 
g = e~ 2w g for some function w G C°(M) which is C°° in M\dM. Let 
W\ := w\m an d w 2 '■= w \M\(M\dMY Since h- g > on <9.M, we have ^- > 
and -pj^- > on dM, where v\ and v 2 denote the inward unit normal vector 
fields to dM in (M,g) and (M\(M\dM),g) respectively. Thus we may 
smoothly extend Wi and w 2 to a neighborhood U of dM in .M so that 
Wi < w and A(Ap w .) G T^ on U for « = 1, 2, where g Wi := e~ 2Wl g. Therefore, 

noting that our background metric g is C 2 ' 1 on .M and w = max{tt>i, -u^} on 
U, we can apply [42, Lemma 3.7] to conclude that g = e~ 2w g is /c-admissible 
in the sense of Trudinger-Wang (This will be simply called A;-admissible in 
the sequel). 

In the following we will follow the idea in [42] to give the proof of Lemma 
5.3. Suppose the Harnack inequality (5.3) does not hold. Then there is a 
sequence of smooth metrics gj := e~ 2W] g G [g]* k such that 

max if 1 — rninw,- > 7, 7 = 1, 2, • • • . 

By subtracting a constant if necessary, we may assume max^ Wj = 0. Then 
min/v; Wj — > — 00 as j — > 00. Consider the function Wj on .M induced by Wj 
through g~j = e~ 2w ' j g. From the above argument we know g~j is /c-admissible. 
Thus [42, Lemma 3.1] shows that for iij := e Wj there holds the Holder estimate 

for some < a < 2 — j* where a and C are independent of j. Note that 
< Uj < 1. By Arzela-Ascoli theorem we may assume that Uj — > w uniformly 
on M for some function w G C a (.M) with < u < 1. Since max» -u^ = 1, 
we have «^0. Define u> := logw, and let 

Su, := P| Ix G X : u>(z) < -/3J 

/3<0 

which is called the set of singularity points of w. Since min^ iij — ► —00 as 
j — > 00, we know S^ 7^ 0. Moreover, since each cjj is /c-admissible, as the 

limit cjw := e~ 2w g is also /c-admissible on .M. 

Since g is smooth away from dM and is locally conformally flat near 
dM, by the /^-admissibility of g^, the argument in [42] shows that near any 
singularity point x of w there holds 

(5.4) w(x) = 2 log \x — xo| + o(l) 

in a normal neighborhood of x$; moreover, the singularity points are isolated. 
For a fixed point y G M\Su,, by using the Bishop volume comparison theorem 
and an approximation argument it was shown in [42, Lemma 3.4] that the 
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ratio 

Q(r) := V °'»' adgil) < w „, o < r < oo, 

where -By^^w] denotes the geodesic ball in Ai of radius r with center at y, 
and o; n is the volume of the unit ball in IR n . But by (5.4) it was shown in 
[42, Lemma 3.4] that each singularity point of w contributes a factor uj n to 
the ratio Q(r). Therefore S$ must consists of a single point, say Su, = {x }, 
and Q(r) = u n . Moreover, noting that the symmetry of w with respect to 
dA4, we must have xq G d M.. 

Next we are going to show that w is C 2,1 away from xq. Since g is smooth 
in M\dM., the argument of [42, Lemma 3.5] can be applied directly to show 
that w G C 1,1 (Ai\dAi). However, since g is only C 2,1 across <9.M, when we 
consider the regularity at a point y G dM.\{x }, we need to check carefully 
the proof of [42, Lemma 3.5] when using the existence result on a Dirichlet 
problem in [16]. We may choose a neighborhood 0\ of y in Ai\{x } on 
which g is conformally flat, i.e. g = e~ 2r, go for some function rj G C 2 ' l (0\), 
where go is the flat metric. Then g$ = e~ 2v go with v = w + rj. Since g^ is 
/c-admissible, there is a sequence of /c-admissible metrics cjj := e~ 2vj go with 
Vj smooth on (9i and Vj — >■ -0 uniformly on 02 for some neighborhood O2 of 
2/o satisfying 2 C 0\. Let {e^-} be a sequence of positive numbers such that 
Sj \ and 

< Ej < o- fc ( X go I Vq% + dijj <g> duj - -|V %| 2 ^o 

where Vo denotes the Levi-Civita connection of go. Consider the problem 
°k (A§ (Vlfij + dtpj <g) c% - ||V ^| 2 ^o)) = £j on £> 2 

<£,■ = Vj on <902- 

It follows from [16] that such <pj exists, ||<^j||c 2 (o 2 ) — C an< ^ {<£?'} is monotone 
increasing. Define (p := limj^^tpj, then (p G C 1,l (02)- As shown in [42, 
Lemma 3.5] (p = v on (9 2 . Therefore w = v — rj G C 1,:L ((!} 2 ). Combining the 
above we obtain w G C 1,l (A4\{x }). By the symmetry of w with respect to 
dM. we have |^ = on <9.M\{a;o}- Moreover the argument in [42, Lemma 
3.5] gives Rg^ = a.e. on A4, where R ga denotes the scalar curvature of g^. 

n — 2 - 

Thus by the Yamabe equation we know v := e~^~ w satisfies 



-A g v + -^)RgV = mM\{xv}, 

f = ondM\{x }. 

Note that g and R g are smooth on At, it follows from the regularity theory 
theory for uniformly elliptic equation with Neumann boundary condition that 
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v G C°°(M\{xq}). Thus w G C°°(M\{x }). By symmetry we correspond- 
ingly have w G C°°((M\(M\dM))\{x }). Therefore w G C 2 ' 1 (M\{x }) ■ 

By the /c-admissibility of g^ and the result in [17] we know g$ has nonnega- 
tive Ricci curvature. The asymptotic formula (5.4) implies that (M\{x }, g$) 
is a complete manifold with Q(r) = uj n . Hence (M\{xo},gw) is isometric to 
the Euclidean space. Consequently (M,g) is conformally equivalent to S n . 
This contradicts the assumption that (M,g) is not conformally equivalent 
to § r |. □ 

Proof of Theorem 1.2. Without loss of generality, we may assume that (M, g) 
is not conformally equivalent to S>™ . As indicated in the proof of Theorem 
1.2, we may assume X(A g ) G T on M and h g > on dM. We will adapt the 
idea in the proof of [42, Theorem C] to complete the argument. 
For a positive function v G C 2 (M) we will use the notation 

5.5 V> = -V 2 t; + - J L <? + —z-vA g . 

n — 2 v n — 2 v 2 



Note that for the metric g v := v n ~ 2 g we have 

2 n / 2 dv \ 

Aq v = ^v^VYv] on M and /i„ = v~^ ( - — + h„v on 9.M. 

n — 2 \n — 2(7// / 

Thus, if we can prove the existence of a positive function v G C 2 (M) such 
that 

f /(A(VM)) = ^(fiov p , X(V[v])er onM, 

(5.6) { 

I £ - ^ V = --^hovi on &M, 

where p = ^|, g = -^, and A(V[i;]) denote the eigenvalues of V[v] with 
respect to g, then w = —-^2 \°& v is a solution of (1.13). 

Since X(A g ) E T on M, h g > on dM, p > 1 and q > 1, it is always 
possible to find positive numbers «o an d £0 such that 

f f(X(V[a })) > ^ (a 2 + e 2 ) p/2 on M, 

(5.7) J 

[ -h g a < -h (al + el) q/2 on dM. 

Let £ G (0, £0] be any number. We consider the auxiliary problem (Pt t£ ) as 
follows 

f(X(V[v])) = ^t Vo (v 2 + e 2 f\ X(V[v])ET onM, 

^-^h g v = -^th (v 2 + e 2 ) q/2 ondM, 

where t > is a parameter. 

Claim 1. For any t > there exists a positive constant C independent of 
e such that any solution v of {Pt, e ) with £ > t an d < £ < £q satisfies v < C 
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on M.. Moreover, for each < e < Eq there exists t > 1 such that {Pt,e) has 
no solution for t >t. 

Indeed, suppose there exist two sequences {t,} and {ej} satisfying tj > t 
and < Ej < £ and a solution Vj of (i"t-, £ ) such that s\xp M Vj — ► oo. Then 
by Lemma 5.3 we have rrij := inf^i^- — * oo. Note that for the function 
v j ■= v .j m . 

f{X(V[vj])) > ^to^omf 1 ^ oo on M, 

f£ - ^M, < -^tohomf 1 -► -oo on dM 

By Lemma 6.1 we have inf^ i5j — >• oo. This is a contradiction since inf^ Vj = 
1. For the second assertion, let i > 1 and let v be a solution of (Pt j£ ). Then 

%-^h g v< -^th £ q on dM. 

By Lemma 6.1 again this implies that v > cot for some positive constant Co 
independent of t. Thus {Pt,e) has no solution if t is large enough since Vt is 
uniformly bounded from above. 

It is important to note that the constant C in Claim 1 does not depend on 

e. Unless stated otherwise, constants appeared below allow e-dependence. 
From now on we denote {Pt,e) simply by (Pt). 

We now define the mapping T t : C 2 (M) — ► C 2 (M) so that for any V\ G 
C 2 (M), T t (v±) is the solution of 

f(\(V[v])) = ^t<p Q (v 2 + e 2 ) p/2 \(V[v])ET onM, 

% - ^h g v = -*=?tho (v 2 + E 2 ) q/2 on dM. 

From Lemma 5.2 it follows that T t is well-defined. Moreover T t (v\) is a 
positive function. By a priori estimates one can see that T t is a compact 
operator for each t > 0. Note that T t = tTi for t > 0, we may continuously 
extend T t to t = by setting T = 0. 

For the number ao > satisfying (5.7) we set 

$:={«£ C 2 (M) : H < a on M) . 

Claim 2. There exists a large number Rq independent of t such that for 
any R > Rq 

(i-T t )- 1 (o)nd($nB R ) = ® 

for < t < 1, where £ R := {y? G C 2 (.M) : |M|c 2 (.M) < R}- 

To see this, let v e (I - T t )-\0) n <9($ n S fl ) for some < t < 1. This 
implies that f is a solution of (Pt) and < v < «o ° n «M. By using (5.7) we 



;r> 



have 



n-2,„ /■ ,2 i _2\P/ 2 



f(\(V[v])) < ^<p H + e 2 T < f(X(V[a })) on M, 



dv n— 2 j 

dv 2 



%v > -^h (a 2 + e 2 ) q/2 > ff - =f^a on 8M. 
Therefore Lemma 6.1 implies that < v < a®. Consequently v G dB R , i.e. 
(5.8) lkl|c2(X) = R- 

However, note that the function v := t~ l v satisfies 

^oe p < f(X(V[v])) = ^y? (t 2 v 2 + e 2 f 2 < C on M, 

-Ci < f - *=rh g v = -^ho [fv 2 + e 2 f 2 < -^h e q on dM, 

for some positive constants Co and C\. By Lemma 6.1 we have \jC < v < C 
and hence Lemma 5.1 gives ||w||c ,2 (A4) < -Ro f° r some number i? independent 
of t. Hence ||f||c 2 (.M) < -^o- Thus, in view of (5.8), Claim 2 holds with this 

Rq. 

From Claim 2 it follows that the Leray-Schauder degree deg(J — T t , $ n 
B Ro , 0) is well-defined for < t < 1 and is independent of t. Since T = we 
have 

deg(J - T\, $ n £ Ro , 0) = deg(J, $ n £? Ro , 0) = 1 

On the other hand, from Claim 1, Lemma 6.1, and Lemma 5.1 it follows 
that there exists R' > R such that \\v ||c 2 (ai) < R' f° r an Y solution v of (P t ) 
with 1 < t < t . Therefore deg(J — T t , B R r, 0) is well-defined for t G [1, t\ and 
is independent of t. Since (Pj) has no solution, we therefore have 

deg(J - Tt, B R ,, 0) = deg(J - T h B w , 0) = 0. 

Let K := B R ,\$ which is closed in C 2 (M). If G" (/ - T^K), then the 
excision property of Leray-Schauder degree implies that 

= deg(I - T u B RI , 0) = deg(J - T 1? $ n P R ,, 0) = 1. 

which is absurd. Therefore T\ has a fixed point v £ in i^, which is also a 
solution of (Pi). Moreover, the definition of $ implies that sup^ i> £ > a > 0. 
It then follows from Claim 1, Lemma 5.3, Lemma 5.1, and the result in [32] 
that 

~ < v £ < C and \\v £ \\ C 2, a{M) < C 

for some positive constant C independent of e, where a G (0, 1). This implies 
that there is a sequence Ej \ such that v £ . converges in C 2 (M. ) to a solution 
v of (5.6). □ 
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6. Appendix 

We include here a comparison principle which is repeatedly used in the 
proof of Theorem 1.2. For a positive function v G C 2 (M) we still use the 
notation V[v] defined by (5.5). 

Lemma 6.1. Assume that (/, T) satisfies (1.3) and (1.5) and that (Ai,g) 
is a smooth compact Riemannian manifold with smooth boundary dM.. Let 
a G C°(dM) and let v,£ G C 2 (M) be two positive functions satisfying 

( f(X(V[v]))>f(X(Vm, \(V[v]),\(V[£])er onM, 
(6.1) { 

( (£-a)v<mm{(£-a)^0} on dM. 

Then either v = £ on M or v > £ on 7W . 

Proof. We first prove that t> > £ on M. Suppose it is not true then by using 
the positivity of v, we find a number j3 > 1 such that (3v > £ on M and 
/?v(x) = £(x) for some x G .M. If x G .M\<9.M, then 

(3v = £, V((3v) = V£ and V 2 ({3v) > V 2 £ at x 

and therefore 

A(^H) < \(V[£\) atx. 
It follows, using (1.5) and /3 > 1, that 

/(A(Vfc]) > /(A(V[/fo])) = f(J3\(V[v])) > f(X(V[v])) at x 

which is a contradiction. 
If x G <9.M , then 

Bv = £ and -^(Pv — > at x. 

One the other hand, using hypothesis in the lemma, the fact /3 > 1, and the 
fact (t|j — a)v < on dM, we have 

Since (/3i> — £)(#) = 0, we have -§^(ftv — £) < at x. Therefore 

^(/3u-0(x) = 0. 

Using the Hopf Lemma, and the strong maximum principle, we must have 
Pv-£ = 0. This implies f(\(V[£\)) > f(\(V[v])) on M as before. We get 
a contradiction again. 

Therefore i> > £ on .A/f. If v > £ on .M, we are done. Otherwise, there 
exists x G M such that v(x) = £,{x). It then follows from the boundary 
condition in (6.1) that J^(u — £) < at x. The Hopf Lemma implies that 
this can not occur unless v = £ on M. If a; G M\dM, the strong maximum 
principle implies v = £ on <9.M. The proof is thus complete. □ 
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